C19>H*HHWW (J P) < 12 > ^ ffl W ^ • (A> 



(H)ftHPfflSi£:BI#^ 

#IH§¥8 -9309 

(43)&B8B 8 *P (1996)18 12 B 



(51)lntCl. e 

H0 4N 5/74 

G0 2F 1/13 

G0 9G 3/36 

H0 4N 17/04 



z 

5 0 5 



(21) tHH#^ 

(22) tfJBlB 



H$gjp6- 141482 
^6^(1994)6 ^230 



(54) [a5W©*i»] ^#«Rtf3&B 
(57) [KM] 

Sit*. 

iA»ABEFOjn<B«Sr*I 



F I 



»**©»9 OL (^ 12 H) 

(7DWISA 000001007 

j|Q^*HJ*m^ 3 TB30# 2 # 
(72)#W# 9111 #- 

(72)fEM* ftta *>« 

SC^*HirF*L*3TB30S2*t *Y 

(72)&9MI ft fctf* 

«Sffi^BBKT^3Te30S2^ 

(74)ftSA ** (*1*> 



P 0.3) 



D (m.O) 
F 

- -p (t . j) 



E 

C (m , n) 



(0, n) 



ft BUT 8-9309 



in** 1 1 9\-u<omtm±.K%*&tt Lxmn^ 

[II** 2] tWafctti^Stt, IWES*iB±o / >*< 
[if** 3] WIB^H#iS;tt. IWEl*a*»fc*9* 
[t»**4] IWB»m*ikK:J:SflWE-rix*©*ffidS 
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s#i-5w £^^£-1-511**5 twia«<o*^*s. 
[tf**7] MfEir;* h^^-^ttE^-t-5**©ac 
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[0 0 19] X. ff*t<lt lB^M*-^< 1 
10 0 2 0] 

[saseg] 

[00 2 1 ] (BU» >lg|1 

5 C #3BfcH©**iHl 1 0 0 (4, ton*?'** ^ U-C 
fif?g/*— y-t-/v=J^t°3- — ^"C'fc^o =>■— !f©A*(4* 

[002 2]BlK*^t, 8(4^r-^-K-efo«?#* 
i?* * * Ojft»*oa* SrtT 5 . 4 1-43 I4&#t® :£ 

Sl-fe Vf- 4 1 ~ 4 3 14, ad^-fS^fSl^f bLTB£B£ 
9,41 (4&ltB©£-t, 4 2 (4£_L, 4 3 I4£ 

[0 0 2 3] [2]2tt&ttSfcir^©StPJ*M^tf>W 
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~ 4 3 (47" ti 3i * <Dm^ V T9&U<0 3 (51- 
5 3) <DSg.M*tm-tZ>h<DX*hZ)c 
[0 0 2 4] <W\&m&<OWFi (IH3~5) >&(C#H 



6 

[0025]i^ 1 14****11 1 0 0±ft<OfflWZ 
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22**= i'h 0» CPUltSl^Wtffl 

/vi§{§, /<9wmfS, yT*94W*y9> 94-* 
-, tt&*ffi». DMA9M) roffl^5rtT5o 3f4^ 

*-ygis-T?fc9, y^v/*!iifc, dram, 
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2T?^fcit5 0 ;:©»&* 4HS*ffiltlw*J»t*fifi 

p ( 1 0, 240) =p ( 1 0. 240- i nt ( ( 240-240) /2) ) =p ( 1 0, 240) 
p(10,239)=p(10,240-int(( 240-239)/ ))=p(10,240) 

p(10, l)=p(10,240-int(( 24O-l)/2))=p(10, 121) 
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ifcS. £t±©tf*«rtT5-fC« P (10,120) ~p 

(10,360) ©g&ffl^P (10.0) ~p (10,420) ©«£H~ 
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[0 06 1] ft. *«W(4±IE<o**OTfcKje**St 
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o ii$*;h,fcatfsei2-e*>a. H'-^ Ei^7 2tfii^7 3 
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[ 0 0 6 8 ] B 1 2fi, »£«*J 2 lC*5lt2.S*tffiW«t 
[0 0 6 91 *1\ ^^SlBOttt, T*Vm<D 

y = ax + b ••(») 

[0 0 7 0] W:> T^y-yfS 1 5 3K*5WC, 

9 21 E»H tl2 9 

[St9 1 

/l : y = »l xx + bl —(9-1) 

/2 : y=a2xx + b2 -.(9-2) 

" a2 1 .-.(9-3) 
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[0071] ^f^si 5 4t?«, um<Dts:-tftme 
iu ei2> 0 2iasB:a-e*>3jM'«j£L. W*'<?*>*i'»** 

1 5 9-, &feX*hMZ*TyyS 1 5 5~iS 
Oo - ^ 1 5 5 •Ctt,-5WE®:*tE«©*K*rtT 

ol^iE*0*3S*ff5. TIED 
#t)£ocofi, uatiB*s**iaa«:i«av^v^»* (BP*. 

M£« (Kx ) o*JE*ltli:©BMR,-Aa t e.lli: G 21 <° 
^/hBa^i:Y*l6lttEffi (KY ) (D^S^I*]t^KI#5r 

1 ) 6 11> 0 12 X^ftttlEfilKx «:«'> 

2) 0 IK 9 12 X^I*l«IEfifiKx SfiiJP 

3) 0 11> 0 21 Y#l&J*|jEtfKy 

4) 91K921 Y*[^]*IEfiIKy 

Kx St/Ky it0J:9**HWW* 
t) N 1) v 2) 0*«:-CJ41 t<5. 
[00 7 3] 7f7yS15 6flt «»«lilBI*_ 
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s/ys i 5 7-e»i> ^»i±9Wfc«iiBi»^ K y 

AM10»c»#ii*, SitiB^©*7P«:tT5. 
[■0 0 7 4] yyS15 4KfcVT, 9 11, 9 12. 

5 [°0 0 7 5] g*_h(D£M-L<-C, h/^-VtrfljE 
L&as&x', Y#ltQ©StjEfc1ltjE««:a#U ^»«iE 

^Hff«iS^ov^X^4, »&0yitf>*&3 (09) £R 
[0 0 7 6] bfci b fc*»fc« 2 

, [0 0 7 7] M. lt«fW2JC*SV^-C, 9 lit 9 12 

mmzftix^ZiK en&9 omtit^x**^* 

,\sis^Mz£^X&X-*&&-f*tbh\^ ffiEmv® 
0K»±-C*>ntfX*lS]©*iEffl[«:»'>***i 5 fci" 
[0 0 7 8] EJLh> RE Ufci 5 fc±E©***ffil«-± 

[00 7 9] ft, ±R^«t?tt* KB*© 4 ^*** 
8©52AB«yiC, HI 6 
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(57)Abstract: 

PURPOSE: To enhance the quality of a displayed image and to improve 
use convenience by contriving the device such a way that image data 
are displayed while being revised to cancel a distortion in a displayed 
image caused by a deviation between optical axis direction of a 
projected light and normal direction to a projected surface. 
CONSTITUTION: Image data consists of m x n sets of pixels and the 
upper left point of the image is set as an origin, from which an X axis is 
set laterally and a Y axis is set longitudinally. A square ABCD depicts 
mapping data of an image stored in a memory section 3. For example, 
when a projection screen is tilted and a displayed image on the 
projected surface is being magnified as one moves toward the right, the 
image is revised as a square ABEF. That is, the image data are being 
revised while increasing the reduction rate in the longitudinal direction 
toward the right of the image. The distortion caused by the projection 
and the distortion on the mapping data are canceled by projecting the 
image data revised in this way onto the projecting surface, and on image 
without distortion can be displayed on the screen. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 
[Claim(s)] 

[Claim 1] A detection means to be the display which projects light and displays information on an 
external plane of incidence, and to detect the amount of gaps of the direction of the optical axis of the 
incident light from the display concerned, and the normal of said plane of incidence, The display 
characterized by having a modification means to change output image data so that the distortion of the 
display image accompanying [ shift and ] this amount of gaps based on an amount detected by said 
detection means may be offset, and the display means which displays an image using the image data 
changed by said modification means. 

[Claim 2] Said detection means is a display according to claim 1 characterized by detecting the amount 
of gaps of the direction of the optical axis of incident light, and the normal of said plane of incidence by 
measuring the distance between at least three points and the displays concerned on said plane of 
incidence. 

[Claim 3] Said modification means is a display according to claim 1 characterized by reducing or 
expanding output image data, changing a scale factor to a longitudinal direction and a lengthwise 
direction so that the distortion of the display image shift and according to this amount of gaps based on 
an amount detected by said detection means may be offset. 

[Claim 4] The display according to claim 1 characterized by performing periodically detection of said 
amount of gaps by said detection means with a predetermined time interval. 

[Claim 5] It is the display which projects light and displays information on an external plane of incidence. 
An acquisition means to gain the proper amount of amendments for capturing the image displayed on 
the plane of incidence, detecting the distortion, repeating the processing which amends image data and 
is displayed on this plane of incidence so that this distortion may be canceled, and canceling this 
distortion, The display characterized by having a modification means to change output image data based 
on the amount of amendments gained by said acquisition means, and a display means to perform image 
display to said plane of incidence using the output image data changed by said modification means. 
[Claim 6] By the comparison with a taking-in means for said acquisition means to display a test pattern 
on said plane of incidence, and to capture this test pattern image, and the test pattern image captured 
by the aforementioned taking-in means and the original test pattern It has a detection means to detect 
distortion of this test pattern image, and a test pattern modification means to change the image data of 
a test pattern based on distortion detected by said detection means. The display according to claim 5 
characterized by repeating the aforementioned taking-in means, a detection means, and a modification 
means until distortion of the test pattern image captured by the aforementioned taking-in means 
becomes smaller than predetermined magnitude, and gaining the amount of amendments of a proper 
image. 

[Claim 7] Said test pattern is a display according to claim 6 characterized by detecting distortion of this 
test pattern image based on the intersection include angle of a straight line [ in / it is two or more 
straight lines which intersect perpendicularly, and / in said detection means / said test pattern image ]. 
[Claim 8] The method of presentation characterized by to have the detection process which is the 
method of presentation which projects light and displays information on an external plane of incidence, 
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and detects the amount of the direction of the optical axis of the incident light from the display 
concerned, and the normal of said plane of incidence of gaps, the modification process which were 
detected according to said detection process, and which shift and change output image data based on 
an amount, and the display process which display an image using the image data changed according to 
said modification process. 

[Claim 9] It is the method of presentation which projects light and displays information on an external 
plane of incidence. The acquisition process which gains the proper amount of amendments for capturing 
the image displayed on the plane of incidence, detecting the distortion, repeating the processing which 
amends image data and is displayed on this plane of incidence so that this distortion may be canceled, 
and canceling this distortion. The method of presentation characterized by having the modification 
process which changes output image data based on the amount of amendments gained according to said 
acquisition process, and the display process which performs image display to said plane of incidence 
using the output image data changed according to said modification process. 

[Translation done.] 



* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
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2.**** shows the word which can not be translated. 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 

[° 001] , u- u 

[Industrial Application] This invention relates to the method of presentation and equipment which 

project light to up to an external plane of incidence, and display information. 
[0002] 

[Description of the Prior Art] Various kinds of projector application devices are known as an indicating 
equipment which projects light to up to a plane of incidence, and displays information conventionally. 
Television of a rear projection mold is realized as what projects an image from the projector of an 
automatic focus mold, and the back of a plane of incidence especially as what projects an image from 
the front of a plane of incidence. 

[0003] Next, the device of image quality adjustment of the plane of incidence in these displays is 
explained below. 

[0004] Like an overhead projector (OHP), an automatic focus mold projector projects light on an 
external plane of incidence, and performs an image output. An image output system consists of two or 
more optical lenses, and can adjust a focal distance now according to distance with a plane of incidence. 
Adjustment of a focal distance is performed by changing spacing with a lens by the built-in motor. 
Moreover, detection of the distance of the plane of incidence and optical system in this device is 
performed by generally measuring the distance of the direction of a projector optical axis through a lens 
system. Below, the device is explained. 

[0005] The measurement device of the distance in the above-mentioned indicating equipment is 
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equipped with the light emitting device which outputs the reference beam of infrared wavelength in the 
direction of a projector optical axis, and the photo detector which detects the reflected light through a 
lens system. A photo detector is a field light-receiving mold component (SPD), and the output changes 
with light-receiving area. By this configuration, when the focal distance of a plane of incidence and a 
lens system suits, the light-receiving area of a photo detector serves as the minimum. Moreover, when a 
focal distance is not proper, the light-receiving area of a photo detector spreads and is detected. Then, 
the processor of a distance detection device carries out feedback control of the lens system motor 
based on the output of this photo detector, carries out the amendment drive of the optical system, and 
adjusts it to a proper focal distance. 

[0006] Next, television of a rear projector mold is explained. This indicating equipment is performing 
expansion projection of a television picture to the projection film surface prepared in device anterior 
part, and has realized the 50-100 inches big screen display. 

[0007] If the configuration inside a device is explained, in order to reduce installation area, a mirror, 
prism, etc. are used and a change of an optical path is made. By this, an include angle takes lessons 
from the optical axis which carries out incidence to a projection film surface, and it is generated by 
distortion in the display screen. Therefore, distortion is amended in optical system. With this 
configuration, since the physical relationship of a projection film surface and optical system is 
immobilization, distortion of the always same condition will be produced. So, in this display, the approach 
of amending distortion with devising a lens and a prism configuration is realized. That is, distortion of the 
above is amended by making the scale factor and include angle of a lens or prism according to the 
optical path of a device. 

[0008] Furthermore, the zoom lens of a camera is known as a device which can change an image scale 
factor. In this device, a motion and manual operation of a built-in motor can perform 
expansion/contraction of a screen to arbitration. Modification of an image scale factor is realized by 
changing spacing of two or more lenses which constitute a zoom lens. 
[0009] 

[Problem(s) to be Solved by the Invention] However, in the above-mentioned conventional example, 
when distance with a plane of incidence changes, and the direction of a normal of a plane of incidence 
and the direction of the optical axis of output light shift, the problem that distortion arises is in an image. 
That is, in a common display, by distortion of the above images, graphic sizes differ by the upper and 
lower sides of the display screen, or a graphic form is distorted, and it does not have a configuration 
which amends such distortion. 

[001 0] While this invention is made in view of the above-mentioned trouble, making it possible to change 
and display that image data amends distortion of the display image produced by gap of the direction of 
an optical axis of incident light and the direction of a normal of a plane of incidence and raising the 
quality of a display image, it aims at offering the suitable method of presentation and the equipment 
which raised user-friendliness. 

[0011] Moreover, other purposes of this invention are determined by detecting distortion of the image 
displayed on the plane of incidence in the amount of modification of the image data for offsetting 
distortion of the display image produced based on a gap of the direction of an optical axis of incident 
light and the direction of a normal of a plane of incidence, and aim at offering the method of 
presentation and equipment which make it possible to obtain the amount of modification of more proper 
image data. 
[0012] 

[Means for Solving the Problem] And [Function] The display by this invention for attaining the above- 
mentioned purpose is equipped with the following configurations. Namely, a detection means to be the 
display which projects light and displays information on an external plane of incidence, and to detect the 
amount of gaps of the direction of the optical axis of the incident light from the display concerned, and 
the normal of said plane of incidence, It has a modification means to change output image data so that 
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the distortion of the display image accompanying [ shift and ] this amount of gaps based on an amount 
detected by said detection means may be offset, and the display means which displays an image using 
the image data changed by said modification means. 

[0013] According to the above-mentioned configuration, based on the amount of gaps of the normal of a 
plane of incidence, and the optical axis of the display concerned, output image data is changed so that 
distortion of the display image accompanying this amount of gaps may be offset, and the display of an 
image is performed by this changed image data. 

[0014] Moreover, said detection means detects the amount of gaps of the direction of the optical axis of 
incident light, and the normal of said plane of incidence preferably by measuring the distance between at 
least three points and the displays concerned on said plane of incidence. By measuring the distance to 
three on a plane of incidence, it is because the length of this plane of incidence and a lateral inclination 
can be detected and the image amendment to length and a longitudinal direction is attained. 
[0015] Moreover, detection of said amount of gaps by said detection means is preferably performed 
periodically with a predetermined time interval. It is because it can respond automatically and high- 
definition image display can be maintained, even when the physical relationship of the display and plane 
of incidence concerned under image display changes. 

[0016] The display of this invention which attains other above-mentioned purposes is equipped with the 
following configurations, for example. Namely, it is the display which projects light and displays 
information on an external plane of incidence. An acquisition means to gain the proper amount of 
amendments for capturing the image displayed on the plane of incidence, detecting the distortion, 
repeating the processing which amends image data and is displayed on this plane of incidence so that 
this distortion may be canceled, and canceling this distortion. It has a modification means to change 
output image data based on the amount of amendments gained by said acquisition means, and a display 
means to perform image display to said plane of incidence using the output image data changed by said 

modification means. _ , 

[0017] According to the above-mentioned configuration, the image displayed on the plane of incidence is 
captured, the distortion is detected, and the proper amount of amendments for canceling this distortion 
is gained. At the time of future image display, image data is changed with this amount of amendments, 
and image display to a plane-of-incidence top is performed. 

[0018] By in addition, the comparison with a taking-in means for said acquisition means to display a test 
pattern on said plane of incidence, and to capture this test pattern image preferably, and the test 
pattern image captured by the aforementioned taking-in means and the original test pattern It has a 
detection means to detect distortion of this test pattern image, and a test pattern modification means 
to change the image data of a test pattern based on distortion detected by said detection means. The 
aforementioned taking-in means, a detection means, and a modification means are repeated until 
distortion of the test pattern image captured by the aforementioned taking-in means becomes smaller 
than predetermined magnitude, and the amount of amendments of a proper image is gained. By gaining 
the amount of amendments using a predetermined test pattern, it is because processing becomes easy 
and it is accelerated upwards. 

[0019] Moreover, preferably, the above-mentioned test patterns are two or more straight lines which 

intersect perpendicularly, and said detection means detects distortion of this test pattern image based 

on the intersection include angle of the straight line in said test pattern image. It is because the amount 

of distortion etc. is obtained by simple numerical calculation and it contributes to simplification of 

processing, and improvement in the speed. 

[0020] 

[Example] 

With reference to an accompanying drawing, the suitable example concerning this invention is explained 
to a detail below the [example 1]. 

[0021] Explanation [ of an equipment configuration ] ( drawing 1 . drawing 2 )> drawing 1 is the 
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perspective view showing a general view of the display in this example. The indicating equipment 100 of 
this example is the pocket mold personal computer which used the projection mold display (liquid crystal 
projector) as a display device. A user's input is performed by the keyboard on a body and the output 
image from echo back and the computer of an input is displayed by the projector. The plotting board of 
dedication, a screen, a wall, etc. can be used for the plane of incidence of a projector. 
[0022] In drawing 1 , 8 is a keyboard and performs various kinds of data inputs. 40 is a projector lens 
and outputs projection light of this projector. 41-43 are distance robots which measure the distance to 
a plane of incidence, and consist of methods using a supersonic wave in this example 1 . Each distance 
robot 41-43 shifts the direction to measure, and is arranged, and as the upper right of a plane of 
incidence and 42 measured the upper left and, as for 41, the distance to the lower left measured in 43. 
each measurement direction is set up. 

[0023] Drawing 2 is drawing showing the relation of the measurement point of a plane of incidence and a 
sensor. 54 is a plane of incidence using a wall surface etc., the projection light from a projector lens 40 
is projected on this plane of incidence 54, and image display is performed. 55 shows the display area 
which a projector outputs. 51 is the point with which a distance robot 41 measures distance. It is the 
point which similarly was set up so that a distance robot 42 might measure 52 and a distance robot 43 
might measure 53, respectively. That is, distance robots 41-43 measure the distance of three points 
(51-53) of the display area edge of a projector. 

[0024] Explanation ( drawing 3 -5) of circuitry> — the circuitry of the equipment of this example is 
explained below. Drawing 3 is a block diagram showing the control configuration in the indicating 
equipment of an example 1. 

[0025] Among drawing, one is CPU which controls the this display 100 whole, and performs processing 
of an operation, I/O hardware control, etc. according to the program stored in the memory section 3. 2 
is a peripheral controller, it is used combining CPU1 and I/O required to control a peripheral device is 
controlled (serial communication, a parallel communication link, a real time clock, a timer, interrupt 
control, DMA control, etc.). 3 is the memory section and contains memory, such as DRAM and Caches 
RAM and ROM, as main memory. 4 is a hard disk drive (HDD) and memorizes user data, the established 
state of equipment, etc. 

[0026] 31 is a keyboard unit and is equipped with a keyboard 8 and the keyboard control section 7 which 
performs the input control from this keyboard 8. 32 is a FDD unit and is equipped with the FDD control 
section 5 which performs data input/output control from a floppy disk drive 6 and this floppy disk drive 
6. Moreover, 34 is a sensor unit and is equipped with the distance-robot section 13 which receives the 
reflected wave while generating a supersonic wave, and the distance detecting element 12 which 
performs distance detection by the ultrasonic sensing method based on the signal from a distance robot 
13. In addition, since there are three sensors of distance robots 41-43 in this example as mentioned 
above by drawing 1 , the sensor unit 34 has three sets of combination of the distance-robot section 13 
and the distance detecting element 1 2. 

[0027] 33 is a display unit, and it drives a projector 11, reading an indicative data from VRAM 10 one by 
one by the display and control section 9, and performing gray scale conversion etc. Moreover, a display 
and control section 9 also performs bus control so that access to VRAM 10 from CPU1 and access for 
carrying out data transfer from VRAM 10 to a display and control section 9 may not collide. Furthermore, 
logical operation, such as AND with the pattern beforehand set up to the contents of VRAM 10, OR, and 
EXOR, can also be performed. A projector 1 1 is a projector display which actually displays, and is 
constituted by a liquid crystal shutter, the source of incident light, the lens, etc. 
[0028] Next, the circuitry of the sensor unit 34 is explained using drawing 4 . In this example 1, a 
supersonic wave is sent from a distance robot 13, and distance is detected by measuring time amount 
until a reflected wave returns. 

[0029] Drawing 4 is a block diagram showing the configuration of the sensor unit of an example 1 . and 
shows the circuitry for one distance robot. In drawing 4 . 60-62 are the circuits of the output system of 
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a supersonic wave. 60 is a pulse generating circuit and generates a start signal by the trigger signal from 
CPU1. 61 is a driver and changes the start signal from a pulse generating circuit 60 into the driving 
signal of an ultrasonic vibrator. 62 is an ultrasonic vibrator and uses materials, such as PZT (zircon lead 
titanate). 

[0030] On the other hand. 63-67 are the detectors of the supersonic wave (reflected wave) which 
carried out incidence. First, 63 is a sensor component and PZT is used like vibrator 62. 64 is pre 
amplifier and amplifies the output signal of the sensor component 63. 65 is a comparator and changes 
the output signal of pre amplifier 64 into digital level. 66 is a counter, and it is used in order to measure 
the time delay of an ultrasonic signal. A counter 66 will start the count of the clock pulse from the clock 
generation circuit 67, if a counter value is cleared with the output signal of a pulse generating circuit 60 
simultaneously. Moreover, a counter 66 stops a count with the output of a comparator 65, and outputs 
the obtained count data to up to a data bus. 67 is a clock generation circuit and generates the clock of 
predetermined time spacing for a counter 66 of operation. 

[0031] Then, actuation of the sensor unit 34 is explained using the timing chart of drawing 5 R> 5. 
Drawing 5 is a timing chart explaining the timing of the sensor unit 34 of operation. 
[0032] 56 is a start signal which a pulse generating circuit 60 outputs. A driver 61 generates a driving 
signal to the timing of this start signal (56), vibrator 62 drives, and a supersonic wave is outputted. 
Moreover, count actuation of a counter 66 is started by the start signal (56). 57 is an ultrasonic 
detection wave outputted when the sensor component 63 receives a reflected wave. 58 is the signal of 
the digital level which operated ultrasonic detection wave (57) orthopedically with the comparator 65, 
and was obtained. This signal (58) shows the timing which ends the count of a counter 66, and calls it a 
count termination pulse. 59 expresses the count period (namely, period from dispatch of a supersonic 
wave to reception of a reflected wave) of a counter 66. 

[0033] Based on the data obtained by the above configuration, it is the following, and the distance d of 

the display and a plane of incidence concerned is made and calculated. Distance d is [Equation 1], when 

the time delay from the pulse output of a start signal (56) to the output of a count termination pulse 

(58) is set to t and acoustic velocity is set to v. 

a - txv /« 
d - — -0) 

It is alike and asks more. At this example, the distance data to the three points on a plane of incidence 
are computed by performing the above-mentioned processing about sensors 41-43. Here, it is the 
distance measured by distance robots 41-43, respectively d1 -d3 It carries out. 

[0034] Image amendment actuation of the display of this example 1 equipped with the configuration of 
the Explanation [ of processing actuation ] ( drawing 6 , drawing 7 , drawing 8 , drawing 9 R> 9)> above 
is explained to a detail. 

[0035] The display of this example 1 computes image correction value by detecting the inclination of a 
plane of incidence for every fixed time amount. And after transforming an output image based on image 
correction value at the time of renewal of a screen, data output is carried out to a projector. That is, 
image data is amended and outputted according to the inclination of a plane of incidence and the 
projector concerned, and distortion of the image by the inclination of a plane of incidence is prevented. 
In addition, detection processing of the inclination of a display screen is performed in the interruption 
routine started by the timer. 

[0036] Drawing 6 is drawing explaining how to detect the inclination of the plane of incidence in this 
example. First, how to calculate the inclination of a plane of incidence is explained using this drawing 6 . 
[0037] In this example, the inclination of a plane of incidence is calculated by dividing it into a lengthwise 
direction (the direction of Y). and each longitudinal direction (the direction of X). Drawing 6 shows the 
condition of having seen the field including the lens of equipment, and the two detection points (E-E 
cross section) of a distance robot from the top. In this condition, that of inclination theta of the 
direction of X is computed as follows. 
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[0038] Point O is an imagination field (forward confrontation) as for which the location of a projector 
lens and 75 make a plane of incidence, and 76 makes a right pair to equipment among drawing. 
Inclination theta of the plane of incidence for which it asks is an include angle which the forward 
confrontation 76 and a plane of incidence 75 make. Here, distance with c and the detecting point 51 is 
set [ the angular difference of the orientation of two sensors ] to b for the distance of A. equipment, 
and the detecting point 52. In this case, inclination theta of a plane of incidence is [Equation 2] from the 
principle of elementary geometry. 

a = (b 2 +c 2 -2«6*c»cosA) ,/2 — (2-1) 

B= arcsin(b • sin— ) •♦•(2-2) 

a 

*-B-(f-y) -(2-3) 

It is alike and is computed more. 

[0039] The inclination of the direction of Y as well as above-mentioned theta can be calculated using 
the lens location O and the relation of the detection points 52 and 53, and sets this to phi. Whenever 
[ angle-of-inclination / as opposed to the forward confrontation of a plane of incidence as mentioned 
above ] (theta, phi) is calculable. 

[0040] Next, the image display procedure by the display of this example is explained. In this example, 
when the inclination of a plane of incidence is detected by the approach mentioned above by timer 
interruption and the inclination of a plane of incidence is changing, correction value is computed based 
on the distance measured by distance robots 41-43. On the occasion of the image display to a plane- 
of-incidence top, image data is changed based on this correction value (after-mentioned), and a 
projection output is performed. 

[0041] Drawing 7 is a flow chart showing the procedure of image correction value calculation started by 
timer interruption. In processing of drawing 7 R> 7, the distance of three points is measured with an 
ultrasonic sensor, and the inclination of a plane of incidence is gained. Next, when an image is projected 
on the plane of incidence arranged with such an inclination, the correction value for using a projection 
image as the image which does not have distortion in a lengthwise direction and a longitudinal direction 
is computed. 

[0042] First, at step S100, distance robots 41-43 are driven and time delay data are gained. At step 
S101, (1) type is calculated about the time delay data obtained at step S100, respectively, and it is 
distance d1 -d3. It computes, continuing step S102 — distance d1 -d3 from — whenever [ angle-of- 
inclination / of a plane of incidence ] (theta, phi) is computed using above-mentioned - (2-1) (2-3) type. 
At step S103, it judges whether the inclination of a plane of incidence is the same as the time of the 
last measurement, and if the same, this processing will be ended as it is. On the other hand, if it is 
judged that the inclination of a plane of incidence is changing, it will progress to step S104. 
[0043] The correction value of an output image is computed at step S104. Here, if a right end and a 
lower limit are made into what time on the basis of the point at the upper left of an image, it will 
calculate whether it becomes the same magnitude as criteria (upper left of an image), and each 
correction value of X and the direction of Y will be acquired. The correction value (Kx and Ky) of X and 
the direction of Y is calculated by the following (3) formulas. Namely, [Equation 3] 

<*•*>-<§ •§> - < 3 > 

********. And in step S105, the correction value computed at step S104 is stored in the memory 
section 3, and this processing is ended. 

[0044] As mentioned above, image correction value can be calculated by the ability to detect the 
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inclination of a plane of incidence by starting the processing shown in drawing 7 R> 7 by timer 
interruption. 

[0045] Next, the flow of the processing at the time of renewal of a screen is explained. 
[0046] Drawing 8 is drawing explaining the approach of amendment processing of the screen by this 
example. In this drawing, image data consists of pixels of a mxn individual, the upper left is a zero, the 
X-axis is allotted to a longitudinal direction and the Y-axis is allotted to the lengthwise direction. Here, a 
square ABCD is mapping data of the image stored in the memory section 3. Moreover, a square ABEF is 
mapping data of the image which amended in the direction of X (longitudinal direction). In processing of 
this example, conversion to a square ABEF is first performed from a square ABCD. After that, the same 
amendment as a lengthwise direction is performed. 

[0047] For example, when the plane of incidence leans like drawing 6 , it will be expanded as a display 
image goes to the right. In order to reduce distortion of such a display image, an image is changed like 
drawing 8 on the mapping data of an image. That is, image data is changed, enlarging reduction 
percentage of a lengthwise direction towards the right of an image. Thus, when the changed image data 
is projected to up to the display screen which inclined like drawing 6 , distortion produced by projection 
and the distortion on mapping data will be offset, and an image without distortion will be displayed on a 
plane of incidence 75. 

[0048] Since this conversion is changed into the graphic form of trapezoidal shape, the scale factor 
changed as it goes to the right changes. It is Ki about the scale factor of the pixel of eye i train. It is Ki 
if it carries out. It is calculated by the following (4) formulas using correction value Kx. Namely, 
[Equation 4] 

Ki = Kx x — —(4) 
m 

It becomes. 

[0049] This Ki Scale-factor conversion of the direction of a train can be performed by using, being a 
degree (5-1), and (5-2) determining the value of the pixel p of eye i train (i, j) using a formula. In 
conversion of this example, count shown by the formula (5-1) and (5-2) the formula is performed for the 
core of conversion of the pixel (i. n/2) of the center of a train, namely, — and (5-1) (5-2) the value of j 
is changed from 1 to n using a formula, and eye i train is changed in permuting a pixel. 
[0050] The formula of conversion is [Equation 5]. 

p(i.j) = P (i, |-im((|-j)/Ki)) 

(i-f.f-J.~tt ~( 5 -D 



P(i,j) = P0. f + int((j + l-f)/Ki)) 

(j-f+l,f+2,-n) -(5-2) 

It is come out and expressed. 

[0051] For example, 640x480 states the count which changes into the train of p (10 j) with the display 
image. Here, the magnifying power of eye i train is twice, i.e.. Ki. A value presupposes that it was 2. In 
this case, the value in each pixel location p(10.240) =p (10.240-int 0) 240-240 / 2=p p (10.240) (10.239) 
=p (10240-int 0) 240-239 / =p(10.240) - p (10 — ) 1=p( 10.240-int (240-1) (/2)) =p(10.121) p(10.241) 
=p(10,240+int (241+1-240) (/2)) =p(10.241) p(10.242) =p (10.240+int 0) 242+1-240 / 2=p (10.241) — It is 
set to p(1 0,480) =p(10.240+int (480+1-240) (/2)) =p (10.360). It turns out that the range of p (10.120)-p 
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(10.360) is expanded to the range of p (10 0)-p (10.420), and the pixel of eye ten trains is expanded 
twice by performing the above count in the lengthwise direction. 

[0052] Moreover. Kx If a value becomes less than one. it turns out that it becomes the image reduced 
as the image went rightward. For example, since it will be expanded as the image projected goes by the 
inclination of a plane of incidence as shown by drawing 6 rightward. it is Kx. It carries out to less than 
one. the image data on memory is reduced as it goes rightward. and distortion of an image is offset. 
[0053] By changing the value of i from 1 to m, and performing transform processing using the formula 
(5-1) and formula (5-2) which were explained above, transform processing is performed about each train 
and image amendment of the direction of X is performed. 

[0054] It can carry out like [ conversion / of the direction of Y ] above-mentioned transform processing. 
First, scale factor Kj of each line It calculates by (6) formulas. After that, image amendment of the 
direction of Y is performed by performing conversion by (7-1) and the formula (7-2) to each line. 
[0055] First, the scale factor of each line is [Equation 6]. 

Kj - Ky x J- -(6) 
n 

It is alike and is obtained more. 

[0056] Furthermore, transform processing of each line is [Equation 7]. 
P(i,j) =p(f-mt((|-i)/Kj),j) 

(i=y,y-V"D -(7-1) 

P(i,j) =*Y + iitt((i + l-y)/Kj),j) 

(i = H +1 £ + 2,.. m ) ...(7-2) 
2 2 

It can be alike and can obtain more. 

[0057] Amendment of a longitudinal direction and a lengthwise direction which were explained above is 
performed to image data, it is projected on the image which amended the inclination of a plane of 
incidence by projecting this, and an image without distortion can be seen. 

[0058] Drawing 9 is a flow chart which shows the procedure of the processing at the time of renewal of 
the screen in this example. First, image data is read from HDD4 or the memory section 3 at step S1 10. 
At step S1 11, transform processing is performed using above-mentioned (4), (5-1). and a formula (5-2) 
about each pixel, and distortion of the direction of X is amended. Similarly, at step S112, transform 
processing using above-mentioned (6), (7-1), and a formula (7-2) is performed about each pixel, and 
distortion of the direction of Y is amended. At step S1 13, the image it became finishing amending is 
written in VRAM 10, and a display and control section 9 performs the display to a plane of incidence 
through a projector 11. 

[0059] As explained above, according to this example 1. the display which is not concerned with the 
physical relationship of a plane of incidence and equipment, and does not have distortion comes to be 
obtained by transforming an output image so that the inclination of a plane of incidence may be 
detected and it may become a normal image on a plane of incidence. By this, a setup in consideration of 
the physical relationship of a plane of incidence and a projector can be simplified, and it becomes 
possible to raise the user-friendliness of a display. 

[0060] Moreover, since distortion amendment of an image is performed by operating image data, its 
compensator mechanisms, such as optical system, are unnecessary, and easy and flexible amendment is 
possible for it. 

[0061] In addition, this invention is not made to limit to the above-mentioned example, and broad 



application and deformation are possible for it. For example, although the ultrasonic sensing method was 
used for the distance robot in this example 1, it can also constitute from a photosensor. What is 
necessary is to project LED and a laser diode on a plane of incidence, to detect the phase contrast and 
reinforcement of a reflected wave, and just to measure distance with this configuration. 
[0062] [Example 2] The above-mentioned example 1 explained the example which uses the distance 
robot of a supersonic wave for detecting the inclination of a plane of incidence. By this example, an 
image is captured with a CCD camera and the processing which amends distortion according to image 
recognition is explained. 

[0063] Explanation [ of circuitry ] ( drawing 10 )> drawing 10 is a block diagram showing the control 

configuration of the indicating equipment of an example 2. In this drawing, the same number is given to 

the almost same thing as the configuration in an example 1, and explanation is omitted here. 

[0064] In drawing 10 . 35 is an image input unit and inputs the situation of a plane of incidence as image 

data. 15 is a CCD camera and is set to the location which can incorporate the whole plane of incidence. 

14 is the image input section, amplifies the output signal of CCD camera 15. and outputs it as image 

data. 

[0065] Processing actuation of this example 2 is explained below by Explanation ( draw.ng 1 1 . drawing 
12 ) of processing actuationX 

[0066] In the display of an example 2. the image of a plane of incidence is inputted at the time of the 
beginning of using of equipment, and image recognition detects distortion of a plane of incidence. And 
the correction value used as a normal image is calculated by repeating detection of the above of 
distortion, transforming an output image little by little. In addition, at the time of renewal of a screen, like 
the above-mentioned example 1. output data are changed according to correction value, and image data 
output of a projector is performed. 

[0067] Drawing 1 1 is drawing showing the pattern for a test displayed at the time of the beginning of 
using in the display of an example 2. In drawing, 71-74 are straight lines displayed as a pattern for a test, 
and the graphic form surrounded in four straight lines is a rectangle. In processing of this example 2. the 
include angle of the angle pinched by the straight line is detected. The angle pinched by the straight line 
71 and the straight line 72 is theta 11 here, and the angle pinched by the straight line 71 and the 
straight line 74 is theta 12. Furthermore, the angle pinched by the straight line 72 and the straight line 
73 is theta 21, and the angle pinched by the straight line 73 and the straight line 74 is theta 22. 
[0068] Drawing 12 is a flow chart which shows the procedure of processing of detecting the inclination 
of the plane of incidence in an example 2. 

[0069] First, at step S150, the pattern for a test is displayed and this image is inputted from the image 
input unit 35. At step SI 51. an edge is extracted, after removing the noise of a screen. At step S152. 
the point which constitutes an edge is pursued and a straight line is detected. First, the sequence of 
points judged to belong to the same segment are extracted, and a linear parameter is calculated using 
the least square method. It is calculated as that on which it was projected at the 2-dimensional flat 
surface, and this straight line is [Equation 8]. 

y = ax + b "'(8) 

It is expressed. .... 
[0070] Next, in step S153. the include angles theta 1 1. theta 12, and theta21 which four straight lines 
which constitute the boundary line of display area make are calculated. Straight line 11 12 The include 
angle theta to make is [Equation 9]. 

11 : y = a 1 x x + b 1 —(9-1) 

12 : y = a2x x + b2 . .(9-2) 

- a2 



0 - arctanl a * - a ' 
|l + al x 



a2 



(9-3) 
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It is alike and is calculated more. 

[0071] At step S154, it judges whether the include angles thetal 1, theta12, and theta21 which a straight 
line makes are right-angled, and if it is affirmation, and it is negation, it will progress to step S159 to 
step S155. Current correction value is changed at step S155. Here, the following conditions are judged 
and correction value is changed about each case, for example, the following — since that the conditions 
of 1 are realized is the case (namely, condition as shown in drawing 6 ) where the plane of incidence has 
turned to the right, an output image turns into an image expanded, so that it went rightward. Drawing 13 
is drawing showing the display condition of the test pattern at this time. Therefore, it is necessary to 
reduce the image data on memory, so that it goes rightward. 

[0072] As mentioned above, it is as follows if the relation between the size relation between thetal 1 and 
thetal 2 and the modification direction of the direction correction value (Kx) of X and the relation 
between the size relation between thetal 1 and theta21 and the modification direction of the direction 
correction value (KY) of Y are shown. Namely, 1 thetal 1>theta12 The direction correction value Kx of X 
Reduction 2theta1 1<theta12 The direction correction value Kx of X Increment 3theta1 1> theta 21 The 
direction correction value Ky of Y Reduction 4theta1 1<theta21 The direction correction value Ky of Y It 
is increased. Here, it is Kx. And Ky It is a larger numeric value than 0, and less than one value is taken 
on condition that 1 and 2. 

[0073] At step S156, it is Kx like an example 1. It uses and the longitudinal direction of an output image 
is amended. At step S157, it is Ky like an example 1 too. It uses and the image of a lengthwise direction 
is amended. At step S158, an image is amended using the acquired correction value, an amendment 
image is written in VRAM 10, and the display to a plane of incidence is performed. Then, the return 
above-mentioned processing is repeated to step S150. 

[0074] In step S154, if judged with thetal 1, theta 12, and theta21 being right-angled, it will progress to 
step S159, the correction value at the time will be stored in memory, and this processing will be ended. 
[0075] The proper correction value of X and the direction of Y is acquired amending a test pattern as 
mentioned above, and the image output after using this correction value is performed. Since it is the 
same as that of processing ( drawing 9 ) of an example 1 about an update process of the image in an 
image output, explanation is omitted here. 

[0076] As mentioned above, as explained, according to this example 2, the completely same 
effectiveness as the above-mentioned example 1 can be acquired by inputting the image of a plane of 
incidence and transforming an output image. Moreover, since proper correction value is calculated based 
on the actually projected image, more exact amendment can be performed. 

[0077] In addition, while theta 1 1 detects distortion by whether it is large or small compared with 90 
d egreeSf you may make it detect the modification direction of correction value in an example 2, although 
thetal 1 are compared with theta 12. For example, if theta 11 is 90 degrees or more and it is made to 
decrease the correction value of the direction of X, the same effectiveness as the above-mentioned 
example 2 will be acquired. 

[0078] As mentioned above, as explained, according to each above-mentioned example, the inclination of 
a plane of incidence and an output optical axis is detected, and an output image can be transformed so 
that normal image formation may be carried out on a plane of incidence. Then, also when distance and 
an inclination with a plane of incidence change, distortion of a screen can be amended easily, and it is 
effective in the ability to always obtain a high-definition image output. Moreover, this can perform 
installation and migration of equipment now quickly, and it becomes possible to raise the user- 
friendliness of equipment. 

[0079] In addition, in the above-mentioned example, although enlarging or contracting of an image is 
always performed in the direction in every direction on the basis of the upper left of an image, it does 
not restrict to this. For example, in case it changes into a trapezoid, criteria are made for conversion of 
an image to always serve as the contraction direction also on the side of the direction which becomes 
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long. That is, when the plane of incidence leans like drawing 6 , and drawing 6 leans to the opposite 
direction at the side AB side of drawing 8 R> 8, in criteria, it is with Lycium chinense and modification of 
an image serves as the contraction direction at the side CD side of **8** . Although there is possibility 
that it becomes impossible to display some images of the part expanded when the image was expanded 
as effectiveness at the time of doing in this way based on correction value (lost), it can prevent that an 
image is lost, if it is always made to make a change in the contraction direction. 
[0080] Furthermore, although the case where a projector is allotted to the front face of a plane of 
incidence is mentioned as the example in the above-mentioned example, it is not for it to be able to 
apply also about the rear projector which allots a projector behind a projection film surface, either, while 
saying. 

[0081] Furthermore, although derivation of correction value is performed using the distance to a plane of 
incidence, the display image of the test pattern of a rectangle like an example 2 is incorporated, and you 
may make it determine correction value that this will serve as a rectangle correctly in an example 1. 
[0082] Moreover, when what (namely, phi= 0) a gap of the direction of the optical axis of the normal of a 
plane of incidence and the incident light of a display does not exist in a lengthwise direction (the 
direction of Y) is guaranteed with the configuration of an example 1, it is not necessary to measure the 
distance (d1 -d3) to three points. Namely, distance d1 to two points of points 51 and 52 And d2 It 
measures and is the correction value Kx of the direction of X. It is clear that what is necessary is to ask 
and just to change image data into a longitudinal direction. 

[0083] In addition, even if it applies this invention to the system which consists of two or more devices, 
it may be applied to the equipment which consists of one device. Moreover, it cannot be 
overemphasized that this invention can be applied also when attained by supplying the program which 
performs processing specified to a system or equipment by this invention. 
[0084] 

[Effect of the Invention] While it becomes possible to change and display that image data offsets 
distortion of the display image produced by this gap based on a gap of the direction of an optical axis of 
incident light and the direction of a normal of a plane of incidence according to this invention as 
explained above, and the quality of a display image increases, user-friendliness improves. 
[0085] Moreover, according to other configurations of this invention, it determines by detecting 
distortion of the image displayed on the plane of incidence in the amount of modification of the image 
data for offsetting distortion of the display image produced based on a gap of the direction of an optical 
axis of incident light and the direction of a normal of a plane of incidence, and it becomes possible to 
obtain the amount of modification of more proper image data. 
[0086] 

[Translation done.] 



* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



-14- 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the perspective view showing a general view of the display in this example. 
[Drawing 2] It is drawing showing the relation of the measurement point of a plane of incidence and a 
sensor. 

[Drawing 3] It is a block diagram showing the control configuration in the indicating equipment of an 
example 1. 

[Drawing 4] It is a block diagram showing the configuration of the sensor unit of an example 1 . 
[Drawing 5] It is a timing chart explaining the timing of the sensor unit 34 of operation. 
[Drawing 6] It is drawing explaining how to detect the inclination of the plane of incidence in this 
example. 

[Drawing 7] It is a flow chart showing the procedure of image correction value calculation started by 
timer interruption. 

[Drawing 8] It is drawing explaining the approach of amendment processing of the screen by this 
example. 

[Drawing 9] It is the flow chart which shows the procedure of the processing at the time of renewal of 
the screen in this example. 

[Drawing 10] It is a block diagram showing the control configuration of the indicating equipment of an 
example 2. 

[Drawing 11] In the display of an example 2, it is drawing showing the pattern for a test displayed at the 
time of the beginning of using. 

[Drawing 12] It is the flow chart which shows the procedure of processing of detecting the inclination of 
the plane of incidence in an example 2. 

[Drawing 13] It is drawing showing the display condition of a test pattern when distortion arises in an 
image. 

[Description of Notations] 

1 CPU 

2 Peripheral Controller 

3 Memory Section 

4 Hard Disk Drive 

9 Display and Control Section 

10 VRAM 

1 1 Projector Display 

12 Distance Detector 

1 3 Distance Robot 

33 Display Unit 

34 Sensor Unit 
40 Projector Lens 
41-43 Distance robot 
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